Maintaining the quality of vaccines through the use of standards: Current challenges and future opportunities.

An international hybrid meeting held 21-22 June 2023 in Ottawa, Canada brought together regulators, scientists, and industry experts to discuss a set of principles and best practices in the development and implementation of standards. Although the use of international standards (ISs) and international units (IUs) has been an essential part of ensuring human and animal vaccine quality in the past decades, the types and uses of standards have expanded with technological advances in manufacture and testing of vaccines. The needs of stakeholders are evolving in response to the ever-increasing complexity, diversity, and number of vaccine products as well as increasing efforts to replace animal-based potency tests with in vitro assays that measure relevant quality attributes. As such, there must be a concomitant evolution in the design and implementation of both international and in-house standards. Concomitantly, greater harmonization of regulatory expectations must be achieved through collaboration with standard-setting organizations, national control laboratories and manufacturers. Stakeholders provided perspectives on challenges and several recommendations emerged as essential to advancing agreed upon objectives.

WHO informal consultation on regulatory considerations for evaluation of the quality, safety and efficacy of RNA-based prophylactic vaccines for infectious diseases, 20-22 April 2021.

This paper presents the key outcomes of the above WHO informal consultation with global stakeholders including regulatory authorities, vaccine developers and manufacturers, academia and other international health organizations and institutions involved in the development, evaluation and use of messenger RNA (mRNA) vaccines. The aim of the consultation was to further clarify the main principles to be presented in an upcoming WHO guidance document on the regulatory considerations in evaluating the quality, safety and efficacy of mRNA prophylactic vaccines for infectious diseases. This WHO guidance document is intended to facilitate global mRNA vaccine development and regulatory convergence in the assessment of such vaccines. The urgent need to develop such a document as a new WHO written standard is outlined in this report along with the key scientific and regulatory challenges. A number of key conclusions are provided at the end of this report along with an update on the steps taken following this meeting.

Development of mRNA Vaccines: Scientific and Regulatory Issues.

The global research and development of mRNA vaccines have been prodigious over the past decade, and the work in this field has been stimulated by the urgent need for rapid development of vaccines in response to an emergent disease such as the current COVID-19 pandemic. Nevertheless, there remain gaps in our understanding of the mechanism of action of mRNA vaccines, as well as their long-term performance in areas such as safety and efficacy. This paper reviews the technologies and processes used for developing mRNA prophylactic vaccines, the current status of vaccine development, and discusses the immune responses induced by mRNA vaccines. It also discusses important issues with regard to the evaluation of mRNA vaccines from regulatory perspectives. Setting global norms and standards for biologicals including vaccines to assure their quality, safety and efficacy has been a WHO mandate and a core function for more than 70 years. New initiatives are ongoing at WHO to arrive at a broad consensus to formulate international guidance on the manufacture and quality control, as well as nonclinical and clinical evaluation of mRNA vaccines, which is deemed necessary to facilitate international convergence of manufacturing and regulatory practices and provide support to National Regulatory Authorities in WHO member states.

Removal of the innocuity test from The International Pharmacopoeia and WHO recommendations for vaccines and biological products.

The innocuity test was indicated as a quality control test to release pharmaceutical and biological products to the market. The test was intended to detect possible extraneous toxic contaminants derived from the manufacturing processes of the product. The test was included in WHO Recommendations and Guidelines for vaccines, biotherapeutics and blood products and in some monographs on antibiotics in The International Pharmacopoeia. Over the past years, the requirements in WHO Recommendations/Guidelines for conducting the test evolved such that it could be waived for routine release of product once consistency of production was established to the satisfaction of the NRA, or that the need for this test should be discussed and agreed with the NRA. However, some users of WHO written standards for biologicals (i.e., Recommendations, Guidelines) and WHO specifications for pharmaceuticals (i.e., The International Pharmacopoeia) requested that the innocuity test be deleted from WHO written standards based on its lack of specificity and scientific relevance. In response to that request, we studied the history of this test and its use by the member states of WHO, and the recommendations in WHO written standards. The outcomes of the study were reviewed by the relevant WHO Expert Committee on Biological Standardization and Expert Committee on Specifications for Pharmaceutical Products who then decided to discontinue this test in WHO Recommendations for vaccines and biologicals and to omit the test from The International Pharmacopoeia.

Review of efficacy trials of HIV-1/AIDS vaccines and regulatory lessons learned: A review from a regulatory perspective.

The clinical development of prophylactic HIV-1/AIDS vaccines is confounded by numerous scientific challenges and these in turn result in challenges to regulators reviewing clinical trial applications (CTAs). The search for an HIV-1/AIDS vaccine will only succeed through the conduct of well-designed, well-conducted and well-controlled human efficacy studies. This review summarizes relevant context in which HIV vaccines are being investigated and the six completed efficacy trials of various candidate vaccines and regimens, as well as the lessons learned from them relevant to regulatory evaluation. A companion review focuses on the scientific challenges regulators face and summarizes some current candidates in development. The lessons learned from the completed efficacy trials will enable the development of better designed, potentially more efficient efficacy trials in future. This summary, supported by the World Health Organization (WHO), is unique in that it is meant to aid regulators in understanding the valuable lessons gained from experience in the field to date.

Scientific and regulatory challenges in evaluating clinical trial protocols for HIV-1/AIDS vaccines - A review from a regulatory perspective.

Clinical development of prophylactic HIV/AIDS vaccines presents many scientific challenges that result in challenges for regulators reviewing clinical trial applications (CTAs). The World Health Organization (WHO) has the responsibility to provide technical support to these regulators. The search for an HIV/AIDS vaccine will only succeed through well-designed, -conducted and -controlled human efficacy studies reviewed and approved by regulators in countries worldwide, particularly in countries where the epidemic has hit hardest, such as in sub-Saharan Africa and Asia. This review summarizes the current candidates in development and focuses on challenges regulators face when reviewing CTAs, such as the evolving landscape of "standard of prevention," trials in adolescents, adaptive trial designs, correlates of protection and their analysis, and access to successful vaccines. There are many unknowns in the field of HIV/AIDS vaccine development and often, there is not a clear right or wrong approach because of the scientific challenges described in this review. Consequently, regulators should not feel that decisions need be made in isolation, when there are many available international collaborative efforts and opportunities to seek expert advice. The WHO provides many such opportunities and support to regulators across the globe.

WHO/Health Canada meeting on regulatory considerations for evaluation and licensing of new meningococcal Group B vaccines, Ottawa, Canada, 3-4 October 2011.

Serogroup B Neisseria meningitides (MenB) is a significant cause of endemic and epidemic outbreaks of the disease worldwide. Although polysaccharide and conjugate vaccines are available against other meningococcal serogroups, the poor immunogenicity of MenB polysaccharide has led to the development of protein-based vaccines. However, the diversity and antigenic variability of MenB strains has been a major challenge. Recently a new generation of MenB vaccines that contain conserved antigens has been developed to provide broader coverage and they are in an advanced stage of development and regulatory consideration. In October 2011, the World Health Organization and Health Canada jointly organized a consultation on regulatory considerations for the evaluation and licensing of new MenB vaccines. The aim was to seek consensus on key regulatory issues relevant to the evaluation of candidate MenB vaccines and on approaches to the standardisation of in vitro assays used in the evaluation process. Participants agreed that functional antibodies as measured in the Serum Bactericidal Activity (SBA) assay could be used to evaluate MenB vaccine efficacy and ways of improving assay standardization proposed. Approaches to bridging SBA data to large collections of strains in order to give an indication of the prospective breadth of vaccine coverage were discussed.

The 2010 global proficiency study of human papillomavirus genotyping in vaccinology.

Accurate and internationally comparable human papillomavirus (HPV) DNA genotyping is essential both for evaluation of HPV vaccines and for effective monitoring and implementation of vaccination programs. The World Health Organization (WHO) HPV Laboratory Network (LabNet) regularly issues international proficiency studies. The 2010 HPV genotyping proficiency panel for HPV vaccinology contained 43 coded samples composed of purified plasmids of 16 HPV types (HPV types 6, 11, 16, 18, 31, 33, 35, 39, 45, 51, 52, 56, 58, 59, 66, and 68a and 68b) and 3 coded extraction controls. Proficient typing was defined as detection in both single and multiple infections of 50 international units (IU) of HPV type 16 (HPV-16) and HPV-18 DNA and 500 genome equivalents (GE) for the other 14 HPV types. Ninety-eight laboratories worldwide submitted a total of 132 data sets. Twenty-four different HPV genotyping assay methods were used, with Linear Array being the most commonly used. Other major assays used were a line blot assay (Inno-LiPa), CLART, type-specific real-time PCR, PCR Luminex, and different microarray assays. Altogether, 72 data sets were proficient for detection of more than 1 type, and only 26 data sets proficiently detected all 16 HPV types. The major oncogenic HPV types, 16 and 18, were proficiently detected in 95.0% (114/120) and 87.0% (94/108) of data sets, respectively. Forty-six data sets reported multiple false-positive results and were considered nonproficient. A trend toward increased sensitivity of assays was seen for the 41 laboratories that participated in both 2008 and 2010. In conclusion, continued global proficiency studies will be required for establishing comparable and reliable HPV genotyping services for vaccinology worldwide.

Performance of commercial reverse line blot assays for human papillomavirus genotyping.

The performance of three line blot assays (LBAs), the Linear Array HPV genotyping assay (LA) (Roche Diagnostics), INNO-LiPA HPV Genotyping Extra (LiPA) (Innogenetics), and the reverse hybridization assay (RH) (Qiagen), was evaluated using quantitated whole genomic human papillomavirus (HPV) plasmids (types 6, 11, 16, 18, 31, 33, 35, 39, 51, 52, 56, 58, 59, and 68b) as well as epidemiologic samples. In a plasmid titration series, LiPA and RH did not detect 50 international units (IU) of HPV type 18 (HPV18) in the presence of 5 × 10(4) IU or more of HPV16. HPV DNA (1 to 6 types) in the plasmid challenges at 50 IU or genome equivalents (GE) were identified with an accuracy of 99.9% by LA, 97.3% by LiPA, and 95.4% by RH, with positive reproducibility of 99.8% (kappa = 0.992), 88.2% (kappa = 0.928), and 88.1% (kappa = 0.926), respectively. Two instances of mistyping occurred with LiPA. Of the 120 epidemiologic samples, 76 were positive for high-risk types by LA, 90 by LiPA, and 69 by RH, with a positive reproducibility of 87.3% (kappa = 0.925), 83.9% (kappa = 0.899), and 90.2% (kappa = 0.942), respectively. Although the assays had good concordance in the clinical samples, the greater accuracy and specificity in the plasmid panel suggest that LA has an advantage for internationally comparable genotyping studies.

International collaborative proficiency study of Human Papillomavirus type 16 serology.

We performed an international proficiency study of Human Papillomavirus (HPV) type 16 serology. A common methodology for serology based on virus-like particle (VLP) ELISA was used by 10 laboratories in 6 continents. The laboratories used the same VLP reference reagent, which was selected as the most stable, sensitive and specific VLP preparation out of VLPs donated from 5 different sources. A blinded proficiency panel consisting of 52 serum samples from women with PCR-verified HPV 16-infection, 11 control serum samples from virginal women and the WHO HPV 16 International Standard (IS) serum were distributed. The mean plus 3 standard deviations of the negative control serum samples was the most generally useful "cut-off" criterion for distinguishing positive and negative samples. Using sensitivity of at least 50% and a specificity of 100% as proficiency criteria, 6/10 laboratories were proficient. In conclusion, an international Standard Operating Procedure for HPV serology, an international reporting system in International Units (IU) and a common "cut-off" criterion have been evaluated in an international HPV serology proficiency study.

WHO Working Group discussion on revision of the WHO recommendations for the production and control of poliomyelitis vaccines (oral): TRS Nos. 904 and 910. Report of Meeting held on 20-22 July 2010, Geneva, Switzerland.

Oral poliomyelitis vaccine (OPV) is a critical part of the polio eradication programme. A high number of doses are administered each year with an impact on billions of citizens worldwide. It is therefore essential that written standards concerning OPV are up to date and widely available. The World Health Organization (WHO) publishes technical guidance on the quality, safety and efficacy of vaccines intended to assist national regulatory authorities (NRAs), national control laboratories (NCLs) and manufacturers. As part of its programme, on 20-22 July 2010 WHO convened a working group meeting to initiate the revision of the WHO recommendations on the production and control of OPV as presently outlined in the Technical Reports Series (TRS) issues Nos. 904 and 910 [1,2]. The attendees included experts from academia, NRAs/NCLs and industry involved in the study, manufacture, and authorization and testing/release of OPV from countries around the world including representatives from China, the European Union, Indonesia, Japan, Mexico, and the USA. The objective was to review the state of knowledge concerning production and control of OPV, with a focus on neurovirulence testing, to determine how the existing guidelines should be updated and what recommendations should be made for the future. The outcomes of this meeting will be taken into consideration in future revision of the WHO TRS.

Global proficiency study of human papillomavirus genotyping.

Internationally comparable quality assurance of Human Papillomavirus (HPV) DNA detection and typing methods is essential for evaluation of HPV vaccines and effective monitoring and implementation of HPV vaccination programs. Therefore, the World Health Organization (WHO) HPV Laboratory Network (LabNet) designed an international proficiency study. Following announcement at the WHO website, the responding laboratories performed HPV typing using one or more of their usual assays on 43 coded samples composed of titration series of purified plasmids of 16 HPV types (HPV6, -11, -16, -18, -31, -33, -35, -39, -45, -51, -52, -56, -58, -59, -66, and -68). Detection of at least 50 IU of HPV16 or HPV18 DNA and of 500 genome equivalents (GE) of the other 14 HPV types (in samples with single and multiple HPV types) was considered proficient. Fifty-four laboratories worldwide submitted a total of 84 data sets. More than 21 HPV-genotyping assays were used. Commonly used methods were Linear Array, Lineblot, InnoLiPa, Clinical Array, type-specific real-time PCR, PCR-Luminex and microarray assays. The major oncogenic HPV types (HPV16 and -18) were detected in 89.7% (70/78) and 92.2% (71/77) of the data sets, respectively. HPV types 56, 59, and 68 were the least commonly detected types (in less than 80% of the data sets). Twenty-eight data sets reported multiple false-positive results and were considered nonproficient. In conclusion, we found that international proficiency studies, traceable to international standards, allow standardized quality assurance for different HPV-typing assays and enable the comparison of data generated from different laboratories worldwide.

WHO meeting on the standardization of HPV assays and the role of the WHO HPV Laboratory Network in supporting vaccine introduction held on 24-25 January 2008, Geneva, Switzerland.

In anticipation of the implementation of new prophylactic HPV vaccines, the WHO is supporting the establishment of a global WHO HPV Laboratory Network whose mission is to "contribute to improving the quality of laboratory services for effective surveillance and monitoring of HPV vaccination impact through enhanced, state-of-the-art laboratory support". WHO convened a meeting at its headquarters, 24-25 January 2008 which placed particular emphasis on the harmonization of HPV Laboratory Network practices and standardization of HPV assays as these are crucial for the success of the HPV Laboratory Network in conducting studies measuring HPV disease burden and vaccine impact. To assist the HPV Laboratory Network in fulfilling its mission, the meeting was attended by all members of the HPV Laboratory Network, representatives of WHO Headquarters and Regional Offices, WHO Collaborating Centres involved in HPV-related work as well as experts from additional HPV laboratories around the world, representatives of national regulatory and control authorities, non-profit organizations and the vaccine industry.